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CN| , We have studied the distinctive features of the Fulde-Ferrel-Larkin-Ovchinnikov (FFLO) instabil- 

ity and phase transitions in two-dimensional (2D) mesoscopic superconductors placed in magnetic 
^ '■ field of arbitrary orientation and rotating superfluid Fermi gases with imbalanced state populations. 

| Using a generalized version of the phenomenological Ginzburg-Landau theory we have shown that 

the FFLO states are strongly modified by the effect of the trapping potential confining the con- 
densate. The phenomenon of the inhomogeneous state formation is determined by the interplay of 
three length scales: (i) length scale of the FFLO instability; (ii) 2D system size; (iii) length scale 
' , associated with the orbital effect caused either by the Fermi condensate rotation or magnetic field 

component applied perpendicular to the superconducting disc. We have studied this interplay and 
resulting quantum oscillation effects in both superconducting and superfluid finite - size systems 
with FFLO instability and described the hallmarks of the FFLO phenomenon in a restricted geom- 
£^ ■ etry. The finite size of the system is shown to affect strongly the conditions of the observability of 

' switching between the states with different vorticities. 
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INTRODUCTION. 



The Zeeman interactions of electron spins with magnetic field is known to be one of the mechanisms destroying 
the singlet superconducting order (see, e.g., [l|). According to this mechanism a homogeneous superconducting state 
becomes energetically unfavorable above the Pauli limiting field H p = A/figV^, where A is the gap value and /is 
is the Bohr magneton. However, superconductivity can appear even at the fields exceeding the H p field provided we 
consider inhomogeneous states with a spatially modulated Cooper pair wave function Q ■ In this scenario the Cooper 
pairs consist of electrons with different spin projections and different absolute values of momentum. 

There are at least two difficulties in experimental observation of the FFLO instability: (i) first, the strong orbital 
effect which destroys Cooper pairs above the upper critical field H C 2 which appears to be much less than H p in most 
superconducting compounds; (ii) second, the impurity scattering which is known to prevent the FFLO state formation. 
Thus, to observe this interesting physical phenomenon we need to find rather clean superconducting materials with 
very short coherence lengths to increase the critical field corresponding to the orbital effect. Alternatively, we should 
consider strongly anisotropic quasi two-dimensional (2D) systems or very thin films in a magnetic field parallel to 
the superconducting planes. Among the compounds which are usually included in the list of strong candidates for 
the FFLO states observation one should mention layered organic superconductors Q and heavy fermion systems like 
CeCoIn^ (see [1] and references therein). 

During the last decade the attention of both theoreticians and experimentalists have been attracted to a new type 
of superfluid systems which are considered as promising playground for the study of this intriguing phenomenon, i.e., 
ultracold Fermi gases in magneto-optical traps Q. The FFLO type instability in these systems is caused not by the 
Zeeman interaction but by the tuning of the population imbalance between two lowest hyperfine states of 6 Li atoms. 
Experimentally this population imbalance is governed by the radio frequency signal inducing transitions between the 
hyperfine states. Thus, changing the population imbalance we should get the inhomogeneous FFLO state with a 
certain intrinsic length scale and this phenomenon is not masked by any kind of the orbital effect. The orbital effect 
in such neutral atomic condensates is associated not with magnetic field but with system rotation which is known to 
be an important part of the experimental procedure of detection of superfluidity in the ultracold gases Q. The FFLO 
states in an ultracold gas cloud should be, of course, modified by the effect of the trapping potential confining the 
atomic system. As a result, the physics of this phenomenon will be determined by the interplay of three length scales: 
(i) length scale of the FFLO instability; (ii) atomic system size; (iii) the length scale associated with the condensate 
rotation = y/H/MCl, where M is the atomic mass and ft is the angular velocity. An analogous interplay appears 
in a thin mesoscopic superconducting disc with FFLO instability caused by the strong magnetic field parallel to the 
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disc plane. The effect of rotation in this case and corresponding length sh ould be replaced by the magnetic field 
component H z perpendicular to the disc plane and magnetic length L# = y^hc/eHz, respectively. The goal of this 
paper is to study this interplay in both superconducting and superfluid finite - size systems with FFLO instability 
and describe the hallmarks of the FFLO phenomenon in a restricted geometry. 

In standard superconductors without FFLO instability the finite system size is known to cause the so called Little - 
Parks effect, i.e. the oscillatory behavior of the phase transition line on the plane magnetic field - temperature 0, H|. 
These quantum oscillations originate from the switching between the superconducting states with different vorticities 
or winding numbers. The quantum oscillations of the critical temperature vs magnetic field (or angular velocity) are 
known to reveal themselves also in infinite 2D FFLO superconductors and superfluids 0, [l(| • Our theoretical work 
aims to the identification of both the similarities and distinctive features of the quantum oscillations in mesoscopic 
systems with and without FFLO instability. We focus here on the case of 2D systems when the quantum oscillatory 
effects appear to be most pronounced. In section II we discuss a modified Ginzburg - Landau model which takes 
account of both the FFLO phenomenon and confinement effect. In section III we consider the case of a mesoscopic 
disc while the section IV is devoted to the rotating Fermi condensates confined in traps. We summarize our results 
in section V. 



II. MODIFIED GINZBURG - LANDAU MODEL FOR 2D FFLO STATES 



Hereafter our consideration of the FFLO phase formation will be based on modified Ginzburg-Landay (GL) theory 
where the appearance of the nonuniform state is caused by a change in the sign of the second-order gradient term in 
the free energy expansion. An appropriate GL functional can be derived from the microscopic theory (see Ref. 
Calculating the superfluid critical temperature one can take the GL free energy density in the form: 

F = a|*| 2 - /3|D*| 2 + 7 |D 2 *| 2 . (1) 

where ^ is the superfluid order parameter, a — a(T — T c q) and T c o is the critical temperature of the second- 
order transition into a uniform superconducting or superfluid state, and D is the gauge-invariant two dimensional 
momentum operator. Note that here we omit the terms of the higher order in \l/ which come into play only below 
the superfluid transition. In the FFLO region the coefficients /?, 7 > and minimum of the free energy functional 
does not correspond to uniform state, since a spatial variation of the order parameter decreases of the energy of the 
system. Certainly, the GL functional provides an adequate description of a long-wavelength FFLO modulation only 
near the Lifshitz tricritical point, however the results of the GL approach can be extrapolated qualitatively to the 
whole region of the FFLO phase. 

A lateral confinement of the condensate can be introduced either using a boundary condition for the order parameter 
^> at the sample edge or adding an external potential well V(r) to the free energy density (U}: 

F = (a + ^(r))|*| 2 - /3|D*| 2 + 7 |D 2 *| 2 , (2) 

where r is the in-plane radius vector. Varying an appropriate free energy functional @ we find: 

7D 4 * + ^D 2 *+(a + y(r))* = 0. (3) 

We restrict ourselves to the consideration of cylindrically symmetric systems and, thus, assume the confining potential 
Vir) to depend only on the radius r, where (r, z) are the cylindrical coordinates. The value ko = \J /3/2 7 in the 
above equation plays the role of the inverse characteristic length scale of the FFLO modulation. It is convenient to 
introduce a dimensionless coordinate p = k r and dimensionless shift of the critical temperature r = a/jk^: 

T c = T c0 + ^r. (4) 
a 

As a result, one can rewrite the the equation ([3]) in a dimensionless form: 

D^ + 2D 2 ^ + (T + i;(p))* = 0, (5) 

where T) p ,e = D/fco and v(p) — V/jk^. 

In the following sections we proceed with the calculation of the shift of the critical temperature for FFLO states 
with different vorticities or winding numbers. We consider two generic examples of restricted FFLO systems: (i) a 
thin mesoscopic superconducting disk of the radius R placed in an external magnetic field tilted with respect to the 
disc plane; (ii) rotating 2D superfluid Fermi condensate confined in a harmonic trap. 
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Figure 1: Schematic phase diagram in the plane H\\ — T for an infinite 2D superconducting film (a) and for a 2D disc of a finite 
radius (b) in a parallel magnetic field Hu . 



III. FFLO STATE IN A 2D MESOSCOPIC DISC 



A thin superconducting disc of a finite radius R placed in external magnetic field H = Hii +H z zq provides a simplest 
example illustrating the effect of Cooper pair confinement on the FFLO state. The gauge-invariant 2D momentum 
operator in the above equations for \E' takes the form: 

D = V + — — A , 

00 

where A = (0 , Ae , 0) = (0 , H z r/2, 0) is the vector-potential of the field component H z = curl z A, and <fio — nHc/\e\ 
is the flux quantum. Considering the limit of vanishing disc thickness we neglect here the orbital effect caused by the 
field component H||. At the same time the Zeeman interaction energy associated with this parallel field component 
Hy is assumed to be crucial and responsible for the FFLO instability. The coefficient (3 = /3(Hu ,T) is a function 
of temperature T and Zeeman energy /is-ffy and vanishes in the tricritical Lifshitz point (T* , H* = H c2 (T*)) : 
j3(H*,T*) = 0. This tricritical point (T*,H*) is the meeting point of three transitions lines separating the normal, 
uniform superconducting and nonuniform FFLO states (see Fig. la). A trapping potential is assumed to be absent 
(V(r) = 0) and confinement of the superconducting condensate occurs due to the boundary condition at the disc 
edge. This Neumann-type boundary condition for a disc in an insulating environment and the gauge A = (0 , Ae , 0) 
takes the form: 



A. FFLO state in a 2D mesoscopic disc in a parallel magnetic field. 



We start our consideration from the case of zero perpendicular component of external magnetic field: H z = 0. The 
equation ([5]) can be simplified and written as follows: 

A^ + 2A ft( * + r* = 0, (6) 

where A Pj g is a 2D Laplace operator written in dimensionless coordinates p, 6. The equation ([6]) with the boundary 
condition 



= (7) 

p=Ro 



defines a set of eigenfunctions and corresponding eigenvalues r. Here we introduce the dimensionless disc radius 
i?o = koR. The maximum eigenvalue r gives us a critical temperature of transition into the FFLO phase. The 
solution can be simplified due to the following obvious observation: the eigenfunctions of the equation © coincide 
with eigenfunctions of the Schrodinger - like problem 

- Ap.gV = q 2 * , (8) 
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with the boundary condition (J7J at the disc edge. The resulting dimensionless shift of the critical temperature r 
depends on the wave number q: 

r(q) = 2q 2 - q i . (9) 

The solutions of Eq. ([5} characterized by a certain angular momentum L can be expressed via the Bessel function of 
first kind J^qp): 

$ = e iLe J L (qp). (10) 

The vorticity parameter L coincides with the angular momentum of the Cooper pair wave function. The boundary 
condition ([7]) gives us a set of zeros z^ n of the derivative of the Bessel function Jl(z): d z Jl{zlu) = 0. As a consequence, 
we get a set of eigenvalues q^n = ZL n /R . In accordance with ([9]) the set of wave numbers q^n determines a set of 
critical temperature shifts 

\ 2 , N 4 



characterizing vortex states with different winding numbers L: 

■$Ln = e lLe J L {q LnP ) . 

To get the critical temperature of the superconducting transition into the FFLO state we need to find the maximum 
of the T c value, i.e. the maximum of the function 

T c - T c0 = -LI max{r L „} . (12) 

a Ln 

In Fig. 2 we plot the dependencies of the dimensionless shift of the critical temperature tx„ vs the parameter Rq 
for different L and n values. For the fixed value of the disk radius R the parameter Rq can be tuned by changing the 
temperature T and/or the in-plane magnetic field H\\ . We see that for a small disk radius R -C 1/ko (Ro <C 1) FFLO 
instability is suppressed (r < 0) and only uniform superconducting state appears to be energetically favorable. With 
the increase in the Rq value the diameter of the disc becomes comparable with the period of the superconducting 
order parameter oscillations and, thus, FFLO state in the disk becomes energetically favorable. It is interesting to 
note that nonuniform FFLO state promotes the vortex states with L ^ 0: the mode L = 1 arises primarily just below 
T* . The switching between the FFLO states characterized by different winding numbers L results in an oscillatory 
behavior of the critical temperature T c as a function of the external field H\\ . In Fig. lb we show schematically a 
typical phase diagram in the plane Hu — T. The critical temperature appears to be degenerate for FFLO states with 
opposite vorticity signs and, as a result, the sinusoidally modulated superconducting states below T c can be formed 
by superpositions of angular harmonics with L and — L similar to those observed numerically in mesoscopic rings [l2j. 



B. FFLO state in a mesoscopic disc in the magnetic field of arbitrary orientation. Little-Parks Oscillations. 

Let us now consider the effect of an additional component of the magnetic field H z , applied perpendicular to the 
disc plane. We use here the gauge A = (0 , As , 0) where Ag = H z r/2, and look for the solution of the Eq. ([5]) (with 
v = 0) characterized by certain angular momentum L 

*(p,8) = f L (p)e lL6 . (13) 

The function ,fh{p) satisfies the equation 

D 2 L (D|/ L )+2D|/ L + r/ L = 0, (14) 
where the operator Dl is determined by the expression 



Dl = -^(/^) - (- - ^r) ■ (15) 



,j 1 d I d \ I L p 
pdp \ dp) \p a\ 



5 



n=l 



<n ^ ^ L=2;n=2 




Figure 2: (Color online) Dependence of the shift of the critical temperature r vs the dimensionless disc radius koR for different 
values of vorticity L. 



Here an = fco \J 4>a /kH z is the dimensionless magnetic length in the units of k . The solution in the disc should 
meet the boundary condition 



dh 
dp 



= (16) 

p = R 



at the disk edge. As in the previous subsection, the eigenvalue r determines the shift of the critical temperature 
caused by the FFLO instability. The eigenfunctions Jl(p) of the problem (ITU) . ([Tflf coincide with the eigenfunctions 
of the differential operator D| 

- D|/z, = q 2 f L , (17) 

with the same boundary condition (|16|) . The relation between the eigenvalue r and the eigenvalue of the operator D| 
is given by the expression ([9]). 

The solution of the equation (I17[) can be expressed via the confluent hypergeometric function of the first kind 
(Rummer's function) F(a, b, z) [l3| 

f L (cj ) )=e-*/ 2 ^ L \/ 2 F(a L ,b L ,cj > ) , (18) 

where 



1 (\t\ , r , i 



a i = - |L|+L + l-2-r« , 6 £ = |L| + 1, 4> = p i /a J H . (19) 



The boundary condition (| 16[) can be rewritten in terms of the Kummer's functions: 

a L F (a L + l,b L + l,<p R ) + % ( H - l) F(ol, 6 £ , a ) = , (20) 



2 V0fl 

where <pR = irR 2 H z /tfio is the magnetic flux piercing the disk area in the units of flux quantum. The equations (|19p 
and (|20|) define an implicit dependence of the eigenvalue on the parameters kg, R, H z and the orbital number L. 
Thus, using Eq. ^ one obtains the dependence of the critical temperature Tj, of the state with a vorticity L on the 
parameters kg, R, H z : 

T L =T c0 + l^T L , (21) 
a 




T - T 



CI) 



Figure 3: (Color online) Typical phase diagrams for 2D discs in the plane (r, 4> a ) for disk radii koR = 1 , 1.2. The arrows point 
to the segments of the rtSa) curves corresponding to different values of vorticity L — 0, 1. The dotted line corresponding to an 
infinite 2D system (see [ij) is shown for comparison. 



where 

r L = 2q 2 L - qi . (22) 
The critical temperature T c of superconductivity nucleation is determined by the maximal Tl value: 

T c = max{T L } . (23) 

The maximal Tl corresponds to the maximal eigenvalue t of the problem (fT4| , fp~6|) . It has been already shown that 
for H z = the function r(g) can be expressed through the zeros of the derivatives of the Bessel functions. These 
values were taken as the zero approximations to roots of the general boundary condition (|2T)f for H z ^ 0. 

In Figs. 3 and 4 we show typical phase diagrams on the plane (r ,<p a = l/ a jy) f° r different disk radii. Here (f> a is 
a dimensionless magnetic field component along the z axis. The phase boundary exhibits Little-Parks oscillations, 
caused by transitions between the states with different angular momenta L. For rather small disk radii (Fig. 3) one 
can clearly observe the regime of the magnetic field induced superconductivity. It should be noted that the switching 
between the vortex states in the disk can occur with large jumps in vorticity AL > 1 (see Fig. 4b). Similar jumps in 
vorticity are known to occur in mesoscopic rings [hH ] and hybrid FS structures [l5j |. 



C. Vortex solution in a disc beyond the range of FFLO instability. Critical field of the vortex entry. 

Unconventional behavior of the vortex states in thin discs placed in a strong parallel magnetic fields reveals, of 
course, not only in the peculiarities of the oscillatory behavior of the superconducting phase transition line. To 
illustrate the effect of Zeeman interaction energy on the basic vortex matter properties in finite size samples we 
consider here the critical field of the first vortex entry into a homogeneous superconducting state close (but beyond) 
the range of FFLO instability. In order to find this critical field we need to calculate the energy difference between the 
states with and without vortex. Neglecting the contribution of the vortex core we can assume the order parameter 
absolute value to be homogeneous ('f ~ e ) and consider only the gradient part of the free energy functional: 

^ = |d 2 r(^ 2 |D*| 2 +e 2 4 |D 2 vI/| 2 ) , (24) 

where Fq is a constant normalization factor. Approaching the tricritical point one can change the balance between 
two gradient terms in the above expression: for H\\ — > H* we obtain £2 S> £1 and, thus, the fourth - order gradient 
term becomes a dominant one. 
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Figure 4: (Color online) (a) Typical phase diagrams for 2D discs in the plane (r, 4> a ) for disk radii koR = 2,5. The dotted 
line corresponding to an infinite 2D system (see is shown for comparison, (b) Jumps in vorticity L vs the dimensionless 
magnetic field <f) a for koR = 2. 

We consider a vortex placed in the center of a disk of finite radius R and take the gauge Ag = H z r/2. The energy 
difference between the states with and without such vortex takes the form: 

R 

2n J rdr 

U 

where £ m = max Integrating over r we find: 
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where </>a = irR 2 H z / '<Pq. The condition <5_F = gives us the field of first vortex entry: 



In R - $ 



2 + ~& \ 



3$^ _ 4$ In R - $ J = 



Here we introduce the dimensionless parameters: R = i?/£ m 3> 1 and a = £|/(£m£i) 2 - It is natural to consider 
now two limiting cases. Far from the range of FFLO instability we can put £1 S> £2 (a <C 1) and find a standard 
logarithmic expression: 4>r ~ ln(i?/£i). The field of the first vortex entry can be written as follows: 



6 » 6 



Close to the range of FFLO instability we need to consider an opposite limit £1 <C £2 (a ^> 1) and obtain: <frn 
(i?/^) 2 / 3 - The scaling behavior of the field of the first vortex entry changes dramatically: 



R 



4/3 



6 >a 



Both coherence lengths (£1 and £2) diverge as one approaches the tricritical point. Considering the above asymptotical 
expressions for Hz* one can see that for Hv, well below H* the field H z c ^ diverges as a function of variable H* — Hit , 

(c) (c) 

while close to H* the critical field H z tends to zero. Thus, the dependence of the critical field H z vs H — H\\ 
should reveal a peak in the vicinity of the Lifshitz tricritical point. 

IV. FFLO STATE IN A SUPERFLUID CONDENSATE CONFINED IN A TRAP. 



As a second example of the effect of the condensate confinement on the FFLO states we consider a superfluid Fermi 
jas trapped by a harmonic potential 

V(r) = - Muj 2 t 2 . (25) 
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Here u is a trapping frequency, M is the atomic mass. Similarly to the previous section we start from the free energy 
density ^ written in notations which are adequate for a rotating superfluid gas. In this case the two dimensional 
momentum operator D can be expressed through the angular velocity vector i~2 = Zq directed along the z axis 

D = V-^[n,r], 

and the coefficient (3 of the term /3| \7M> | 2 in the expression ([2]) depends on the population imbalance Sfj,. The rotation 
of superfluid gases plays a similar role as the orbital effect in superconductors. Varying the free energy functional and 
introducing a dimensionless radial coordinate p = k^r we find: 

T>%y + 2-Dl e y+(T + v Q p 2 )y = Q, (26) 
where T> p .e — D/fcg and the parameter vq = Muj 2 /2jkQ characterizes the trapping potential. 



A. FFLO state in a parabolic trapping potential. 

In the absence of rotation (f2 = 0) the Eq. (f2l)]) can be simplified: 

A 2 e V + 2A p , e * + (r + v p 2 ) * = , (27) 
where A p .# is a 2D Laplace operator written in p, 9 coordinates. Introducing a 2D Fourier transform 

* = / d 2 qe lqr >(q) (28) 



one can write the equation l|27p in the momentum representation as the Schrodinger-like equation with the potential 
U(q) = q 4 - 2q 2 : 

-v A^ + U(q)i> = -Tip. (29) 

One can see that the solution of Eq. (|27p with minimal energy — t should correspond to the zero angular momentum: 
L = 0. Indeed, the momentum dependent contribution to energy is positive and proportional to L 2 . For rather small 
vq values the lowest energy level — r in this Schrodinger - like equation is close to the value —1 and the wave function 
is localized near the potential minimum. As a result, one can can introduce the coordinate s = q — 1 and expand the 
potential near the minimum U ~ — 1 + 4,s 2 to consider an approximate oscillator - type solution. Indeed, for \s\ <C 1 
we obtain: 

d 2 

-v q —tP + Ls 2 ^ = {1-t)^. (30) 
The lowest energy level of this harmonic oscillator and corresponding wave function take the form: 

r = 1 - 2y/^ , V = e- s2/ ^° . 

The expression r = 1 — 2^/vo gives us the critical temperature of the FFLO state. One can see that the FFLO 
instabitily appears only for rather small trapping frequencies: Vq < 1/4. To find the eigenfunction in the r space we 
should consider the inverse Fourier transform: 

*~ J dse- s2 ^J ((l + s)p) , 

— OO 

where Jq is a Bessel function of the zeroth order. Considering the asymptotical expression for the Bessel function at 
/)> 1 we find: 

+oo +oo 

f dse- s2 /v / ^cos((l + s)p-7r/4) = — Re [ d se -* 2 /v^ e i(l+«)p-^/4 = coa / p _ w 4 ) e Vv^/4 . 

— oo — oo 

Thus, the wave function strongly decays with increase in the trapping frequency and the number of observable 
oscillations is of the order of 2vq 1 ^ 4 — 2fc (/?/Mu; 2 ) -1 / 4 . 
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B. FFLO states in a rotating superfluid gas in a parabolic trapping potential. 

As a next step we study the effect of rotation (0 ^ 0) on the superfluid states of the Fermi gas trapped in the 
parabolic potential well (|25p . We look for the solution of Eq. (|26l) characterized by the conserving angular momentum 
L: 

y L ( P ,9)=f L (p)e* Le , (31) 

where /l satisfies the equation 

D| (D| f L ) + 2D| f L + (r + v Q p 2 ) f L = 0, (32) 

and 4> a = 2MQ,/hk 2 is the dimensionless rotation frequency. Let us consider the following expansion for the order 
parameter: 

oo 

/i(p) = ^2c n u nL (p), (34) 
n=0 

where u n L are the eigenfunctions of the operator — D| corresponding to the eigenvalues 

ql L =2<p a {2n + L+\L\ + l) , 

and the coefficients c n satisfy the equation 

( 2 qlh ~ ?ni) C n~^2 v nm Cm =TC„. (35) 

m 

The matrix elements 

oo 

v nrn = v J P dp {u mL p 2 U nL ) 


are nonzero if m = n or m — n ± 1: 

v^ n = ^-(2 n +\L\ + l), ^(„ + i)=-^V(n + l)(n+|i| + l), if B _ 1)n = - J V™ (n + \L\) . (36) 

The set of normalized eigenfunctions u n L(p) can be written as follows: 

unLip) = f^^§ e ^ ap2/2 ^ 1 L 1/2 F ( _n ' 1 L 1 + 15 ^ 2 ) ' (37) 

pdp (u nL u mL ) = S nm . 

The maximal eigenvalue r of the above problem determines the shift in the critical temperature of the FFLO transition. 
Within the first-order perturbation theory in vo one can get the following expression for the temperature shift t u l vs 
the dimensionless rotation frequency <p a : 

TnL = 7$ - V L nn . (38) 

Thus, perturbation theory provides us a simple estimate for the FFLO transition temperature: 

r = max [m a ~ V /c/> a )(2L + 1) + v L/^ a - 4<f> 2 a (2L + l) 2 ] 

In Fig. 5 we show the results of the numerical calculation of the dependencies t{4>o) for different trapping frequencies. 
These phase diagrams appear to be in good qualitative agreement with the above estimate for not too small <fi a values. 
For rather large trapping frequencies one can clearly observe the regime of the rotation induced superfluid transition. 
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Figure 5: (Color online) Typical phase diagrams in the plane (r, (f> a ) of a rotating Fermi condensate for different trapping 
frequencies (wo = 0; 0.02; 0.1; 0.5). The arrows point to the segments of the r(cf>a) curves corresponding to different values of 
vorticity L = 0, 1, 2. 



V. CONCLUSIONS 

To sum up, we have studied the effect of confinement of superconducting and superfluid condensates on the phe- 
nomenon of FFLO instability. We have found the following hallmarks of the FFLO phenomenon in a restricted 
geometry: (i) both the finite system size and parabolic trapping potential are responsible for suppression of the quan- 
tum oscillations of the superfluid critical temperature; (ii) the spatial oscillations of the superfluid order parameter 
in the FFLO regime are suppressed by the increase in the trapping frequency; (iii) change in the Zeeman interac- 
tion energy in the mesoscopic superconducting system can induce phase transitions between different inhomogeneous 
FFLO states; (iv) switching between the vortex states in confined geometry can be accompanied by giant jumps in 
vorticities; (v) rotation induced superfluid transition in a Fermi gas cloud for rather large trapping frequency; (vi) 
superconducting transition induced by the perpendicular magnetic field component in a mesoscopic superconducting 
disc; (vii) unusual scaling in the dependence of the field of the vortex entry vs system size in the vicinity of FFLO 
instability. We believe that these theoretical predictions can be used for experimental identification of the FFLO 
phases in both mesoscopic superconductors and superfluid Fermi gases. Note in conclusion that the physics of the 
vorticity switching in the systems studied in this paper is in some respects similar to the switching phenomena in 
multiply connected hybrid superconductor/ferromagnet structures where the imbalance in spin populations is induced 
by the ferromagnet exchange field |16j . 
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